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ABSTRACT 



This document reports on an assessment of the 5-year 



Arizona Career Ladders Pilot-Test Teacher Incencive Program. Research 
and evaluation of the program were conducted in the 14 presently 
participating districts. A model was developed of essential 
organizational components which must be functioning at healthy levels 
for effective operation. The components are: (1) focus 
factors — student achievement and teacher development and leadership; 
(2) critical support factors — teacher and administrator evaluation, 
motivation, professional input and ownership, and program designs and 
structures; and (3) professional networks — state financing and 
funding, and legislative guidelines. Program participants were asked 
to complete a survey which assessed their perceptions of the impact 
and appropriateness of the Career Ladder program in these key 
organizational areas. A summary of results is presented; charts 
detail the motivators and demotivators listed on the organizational 
readiness assessment model. (JD) 
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ACCOUNTABILITY IN EDUCATION 



THE ORGANIZATIONAL READINESS ASSESSMENT MODEL: 



Elements of Motlvatlon/De-Motlvation Related to 
Conditions Within School District 
Organizations 



Motivation involves inspiration, 
reason and purpose. Organizations, 
and the environmental cultures wiiich 
emerge within them, exhibit varying 
levels of conditions which dramatically 
affect an individual's directed energies 
toward carrying out professional goals. 

R. Packard 



Overview 



The Organizational Readiness Assessment Model was developed from five years of 
researching the Arizona Pilot-Test Teacher Incentive Program: Career Ladders. In 
1985, the Arizona Legislature established a five-year career ladder pilot program 
under the direction of the Joint Legislative Committee on Career Ladders (JLCCL). The 
purpose was to implement a program for rewarding teachers based on actual 
performance, rather than solely on years of experience and accumulated college credits. 
Research and evaluation of the program in the 14 presently participating districts is 
being conducted by the Center for Excellence in Education at NAD in cooperation with 
researchers from the U of A and ASU. A number of doctoral dissertations are also 
focusing on various aspects of program implementation. 

Research & Evaluation Methodoloav 

Data is collected and compiled annually for the purposes of policy development and 
legislative refinement. Formal reports are presented to the JLCCL, and results are also 
fed back to individual districts. 

Concepts Crucial to Pron^ram R^ fprm 

The researchers have developed a model of essential organizational components which 
must be functioning at healthy levels for effective reform. They consist of focus factors, 
such as student achievement and teacher development & leadership. Critical support 
factors include such components as teacher & administrator evaluation; motivation; 
professional input & ownership; and program designs & structures. Essential elements 
for educational Improvement & success are at the base of the model and Include 
professional networks; state finance & funding; and legislative guidelines. These 
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individual organizationai components need to be assessed as to their current readiness to 
support an external teacher incentive program within the district. In doing so, each 
district must address the following issues: (1) Has there been adequate restructuring of 
all Interrelated district components which impact teacher development & student 
learning? (2) Is teach6r performance appropriately assessed? (3) Is the teacher 
evaluation system perceived as fair & objective? 

Data Collection & Analyftia 

Program participants are asked to complete an annual survey which assesses their 
perceptions of the impact and appropriateness of the Career Ladder program in key 
organizational areas. They are also asked to identify program strengths and weaknesses 
in the form of open-ended questions. Several studies have examined program impact 
using standardized achievement test scores. Small-group interviews have probed 
participants' perceptions, attitudes and emotional reactions to the effects of the program 
upon their academic, interpersonal and organizational activities. In addition, a 
"profiling" procedure has been developed which diagrammatically shows the current 
"level of operational health" of each organizational component, thereby indicating 
overall district readiness for program implementation. 

Summary of Program Results 

The following are the major findings: 

1 . School district organizations show extreme diversity with respect to current 
capabilities to implement such reform efforts successfully & efficiently. They differ 
dramatically in their needs for outside assistance in making improvements and 
capacity to demonstrate accountability for program goals. 

2. A comprehensive restructuring of the total school district organization may be 
necessary in order to integrate the components which critically impact teacher 
development & related student achievement. Each district needs to be assessed & 
profiled to dete.'mine its current readiness level. 

3. Successfully restructured districts have increased their impact on student learning 
potentials by more than 150% after CL implementation. Their impact on student 
achievement is over 225% greater than that of non-CL districts in the state. 
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4. A critical barrier to successfui educationai reform is the difficuity of "Transfer of 
Knowiedge" into poiicy. That is, we need to know: "What ievei of thinking is used by 
educational & legislative decision makers in developing and implementing policy for 
Improving schools?" 

5 . There are great concerns expressed by teachers about factors affecting morale within 
school systems. Perceptions of isolation & authoritarian control are especially 
evident. Negative influences operating within schools have affected organizational 
climate, psychological environment and internal communication procedures. 

Level of Teacher Motivation Depends on the Developmental 

Readiness of the Total Organization and its Essential 

Elements 

System Readiness to Motivate. To become effective organizations which have the 
greatest impact on positive teacher development and motivation, districts must recognize 
the necessity of developing total school system readiness. Teachers who are just coming 
out of colleges and facing the realities of educational systems need to realize that school 
districts differ greatly in their suitability as places to work. Many new teachers have 
the idea that "schools are schools;" that Is, they all provide an equally supportive 
environment for development of teaching skills and effective student learning. This is 
nS2l true! 

Districts are extremely unequal {between sciiool systems) in their 
organizational capabilities and resources to impact teacher motivation and the 
development of student learning potentials (A holistic model of interrelated components 
affecting motivation appears on the following page). In addition, organizational 
components {within school systems) exhibit varying capabilities and levels of resources 
to impact positively all school goals, including motivation of personnel to perform at a 
high level. One inappropriately functioning component or negative factor can anchor and 
drag the others down, thereby keeping them from attaining the institutional goals (An 
example of assessing and profiling within-district elements appears on pages 5-6). 

The matr.x tables beginning on p. 7 depict these interrelated organizational 
factors and identify the specific motivators and de-motivators affecting each one. School 
systems, individual schools within a district and departments or grade level areas within 
schools all vary in the types and amounts of existing motivational and de-motivational 
conditions. 
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Figure 2 

MAPPING THE DEVELOPMENTAL PROCESS 
FOR EFFECTIVE SCHOOL REFORM: 

Designs and Structures 
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A Model of Interrelated Components of Program Support and Focus 
for Effecting Change and Reform In Education 
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Figure 4 



DISTRICT READINESS PROFUJB OF STRENGTHS Aim WEAKNESSES 
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Figure 5 
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MOTIVATORS & DE-MOTIVATORS: 
ORGANIZATIONAL READINESS ASSESSMENT MODEL 



FACTOR 



Student Achievement: 
Production & Outcomes 



CurriculumAnsUiiction/ 
Student Achievement 
Measurement 



MOTIVATOR(S) 



* Increased teacher ability to demonsUate accountability by learning 
to calculate/assess pre-post lest gain scores using appropriate 
statistical/qualitative procedures 

♦ Opportunities to develop own tests/measures which are most 
appropriate to each teacher's subject area & current ability ievel(s) 
of students 



* Greater focus on: 

a) higher levels & quality of academic content 

b) improved teacher skill levels 

c) variety & scope of related teaching methods & instructional 
strategies 

* Ongoing curriculum alignment focused on well-iU"liculalcd district 
learning objectives 

* Satisfaction experienced by grciUer teacher input into such 
curriculum alignment 



DE-MOTIVATOR(S) 



* Lack of objectives tailored to individual teacher & student 
needs/abililies/subjecl area(s) 

* Failure to consider explicitly & incorporate principles of 
human growth & development (e.g., racking the social & 
emotional, as well as the academic, growth of students) in 
seuing objectives 

* Haphazard approach to assessing individual itachor gains 
(no systematic long-range plans for tracking performance) 

Reliance on outdated/inapplicable standards (e.g., national 
norms which do not adequately reflect local conditions) 



* Lack of valid, well-articulated & aligned curriculum for local 
objectives and conditions 

* Failure to consider explicitly & incorporate principles of human 
growth & development (e.g., u-acking the social & emotional, 
as well as the academic, growth of students) in seuing objectives 

* Lack of encouragement of innovation in local instioiclional 
practices 

* Failure to apply & learn the latest multimethod (qualitative & 
quantitative) technological procedures for measuring student 
progress & teacher accounlability lor that progress 
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MOTIVATORS & bl : MOTIVATORS: 
(Page 2, Cont'd) 



FACTOR 


MOTIVATOR(S) 


DE-MOTIVATOR(S) 


Teacher/Specialist 
Skills Development & 
Leadership 


* Emergence of "teacher leaders" 

* Greater amounts of: 
a) inservice 

menionng 

c) peer coaching 

d) general skills development 

* Increased emphasis on proper planning 

^ Focus on improved interpersonal & communication skills 

* Equal emphasis on principles of human growth & development, 
along with flraHftmic content 


Inadequate inservice focused on teacher skills 
development/leadership 
* Failure to recognize role & importance of "instructional 
specialists" (e.g., librarians, counselors) as equally important 
professionals to student growth & development 
Lack of encouragement of innovation in local instructional 
practices 


Administrator Skills 
Development & 
Leadership 


* Shared decision-making between administrators & teacher-leaders 

* Greater administrator awareness of day-to-day classroom activities 

* Ongoing inservice opportunities for administrators 

More opportunities for "hands-on" involvement by administrators in 
student achievement assessment* evaluation planning & implementation 


Failure to include administrator input into decisions cc .iceming 

teacher incentive programs such as Career Ladders 

(e.g., participation in the evaluation process) 

Failure to provide adequate inservice & other reliable information 

about the workings/objectives of such programs to school & 

district adminifsirmnrs 


Evaluation 
(Teachers/Specialists 
& Adminislraiors) 


* Development of more objective & specific evaluation procedures 

* Greater input from teachers & administrators into the formulation 
& implementation of the evaluation process 

* Resulting increased perception of "fairness" of evaluation system 

* Improved training procedures for evalualors relative to implementing 
the evaluation procedures which have been developed 


Failure to develop valid & reliable evaluation procedures which 
are perceived as "fair & objective" by uhose being evaluated; 
e.g., authoritarian and/or haphazard approaches to evaluation 
Failure to incluc^^^ teacher & administrator input into the 
development & refinement of such an evaluation system 
Using evaluation criteria which, while perhaps "measurable," 
do not adequately measure key aspects of student achievement 
& teacher accountability (e.g., process evaluation only; or 
_ ___"cookhook" approaches to assessing teacher performance^ 


Motivation 
(Intrinsic & Extrinsic) 


* Increased sense of professionalism 

Increased pride in being able to demonstrate accountability 

* Increased satisfaction with teacher development & professional 
growth opportunities (e.g.» inservice, mentoring, ollter 
tfiachpr-lftadfti\hin artiviti£*<j^ 

Greater opportunities for earning increased fmancial incentives 
(in addition iO the traditional criteria of years of experience & 
accumulated college credits to dale) 


* Inadequate opportunities for teachers to experience the satisfactions 
of such intrinsic rewards as "increased professionalism, leadership," 
etc., by not providing sufficient inservice, mentoring & related 
professional growth activities 

* Distribution of monetary incentives in a way which is perceived as 
"unfair & not objective" (e.g., not based on having a well-developed 
& valid evaluation process, as described above), thereby engendering 
jealousies & other dysfunctional reactions 

* Having an overall reward system in place ( for both intrinsic 
& exuinsi: rewards) which is perceived as authoritarian 
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MOTIVATORS 6:. DE-MOTIVATORS 
(Page 3, Cont'd) 



FACTOR 


ManVATOR(S) 


DE-MOTWATOR(S) 


Local Finance & Funding 
(Salary Schedule) 


^ More eouilahic di<\trihiitinn of avdilahle fiind<; 
Greater proportion of budgeted amounts going directly to teachers 
recognized as top performers (e.g.» designing & implementing a 
true "performance-based" approach to salary structure) 
Ability to adjust allocation/distribution of funds to meet specific 
& unique local conditions (e.g.» special circumstances related to 
teacher recruitment & retention) 


* Poor fiscal budgeting practices (e.g., underestimation of costs 
and /or overestimation of revenues received) 

* Automatically allocating entire amounts received for "increased 
teacher salaries," while making little/no provision for such 
necessary expenditures as "development of local R&D unit" 

or "consultant assistance to acquire technology to measure student 
achievement validly" 


District Research & 
Development 
(Program Evaluation) 


* Development of "own," locally based R&D unit(s) on the 
district level 

^ Asa result, increased opportunities to plan & conduct locally 
based research studies in areas such as the following: 

a) student achievement 

b) teacher accountability 

c) effectiveness of local instructional practices 

d) issues of teacher morale* turnover, etc. 


Failure to establish own local R&D unit 

^ pAillliK* tn hlldfiPRt QiiffiriPnt fundus tn hpcrin 5inr1 ronfiniip tr\r5il 

research and development activities 
Failure to apply & learn the latest multimethod (qualitative & 
quantitative) technological procedures in research & 
development activities 
* Lack of encouragement of innovation & initiative with respect 
to local R&D projects 


Professional Input 

# flit t A \\ 

^uwnersnipj 


Ongoing & reliable channels of direct teacher input into decision 
making which directly affects them (e.g.» policy development) 


^ Little/no opportunity for participative management (input from 
teachers & adminisyators into day-to-day decision making which 
directly affects them) 

As a result, not capitalizing on the inherent satisfactions & 
intrinsic rewards of "being listened to" 
^ Poor channels of communication regarding such decisions 

(e.g., lack of timely, relevant, & reliable information dissemination 
to all affected parties) 


Program Designs 
& Structures 


* Focus on "excellence in instruction" in recognition/reward system 
Encouragement of innovation in teaching methods & other 
opportunities for teacher leadership (e.g., mentoring, inservice, 
assisting with curriculum alignment) 

^ Designing rules & regulations "with teachers' needs in mind" 
Greater financial "stewardship'* & related demonsU^ition of account^ 
ability for the public trust (e.g., concern for realizing maximal 
tangible t)cncfits in exchange for program dollars received & 
cx(>cndcd) 


^ Lack of consideration of local conditions & circumstances in 
developing own rules & guidelines for program p^u'ticipation 
(too much rigidity in program designs & sUiicturcs; over-reliance 
on existing rules & regulations elsewhere which may not take 
into account unique local conditions) 
Little/no opportunity for participative management (input from 
teachers & administrators into day-to-day decision making which 
directly affects them) 

* Pailurc lo consider overall system readiness (e.g., by applying 
diagnostic multimethod technologic procedures such as "profiling") 
in developing and/or revising program designs & slniclurcs 
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MOTIVATORS & DE-MOTIVATORS 
(Page 4, Cont'd) 



FACTOR 


MOnVATOR(S) 


DE-MOTIVATOR(S) 


Local Governing Board 


* Active desire by Board members to learn more about teacher-incentive 
programs such as Career Ladders 

* Enhanced interpersonal relationships & improved channels of 
communication among Board members, administrators & teachers 


* Little/no attempts to provide local governing board with 
information related to external reform programs, such as Career 
Ladders, prior to their implementation 
Little/no opportunity provided to board for participative 
management (input into day-to-day decision making concerning 
program administration & implementation) 


Organizational Factcx's 
(Climate & 
Communication) 


* Improved multi-directional ("top-down & bottom^up"") channels of 
communication within the entire organizational structure 

* Availability of timely, relevant & dependable information for 
decisicMi-making to all affected parties in the organizational hierarchy 
(all teachers, administrators & support stafQ 

* Satisfaction with perception of increased input into decision making 
& {^plying one's own perspective & expertise to policy development 

* A related sense of "being listened to** 

* More effective i»x)cedures for managing conflict, thereby reducing 
stress & other dysfunctional consequences 


Repressive, authoritarian psychological & interpersonal 
environment (e.g., fostering of jealousies & rivalries) 

* Poor channels of communication (e.g., information filtering 
& distortion) 

Corresponding perception by members of **not being listened to** 


Change & Improvement 
(Long-Range Plans) 


* Greater overall focus on curriculum alignment 

^ U5'e of the latest technological procedure^methods for establishing 
reliability & validity of the tests & measures used in the district 

* Greater concern for teacher skills development, evaluation & 
improvement 


* Failure to develop adequate long-run strategic plans 

(e.g., haphazard, "seat-of ^he-pants,'* "fighting fires" type of 
day-to-day decision making) 

* Too far to go -- & don t know how to get there 

Failure to budget sufficient funds to begin and continue local 
research & development activities & other necessary start-up 
expenditures for long-range strategic planning & implementation 
Failure to acquire & incorporate the latest mullimethod technological 
procedures for long^-range planning, evaluation & implementation 


District Readiness Level 
(Assessment) 


* Application of "profiling" procedure to assess current lcvel(s) of 
operational health of each critical organizational support & focus 
factor, especially prior to initiation of external reform programs 
such as Career Ladders 

* Using results of profiling to initiate remedial processes/procedures 
to improve iliosc support & focus factors which may be currently 
below par 

* Ongoing evaluation/profiling of each individual component with 
respect to its functioning & readiness for overall program goals such 
as improved student achievement & teacher accountability 


* *'Impulsively" adopting external reform programs such as 
"Career Ladders," without consideration of system readiness 
to implement such outside programs 

* Failure to apply appropriate diagnostic mullimethod 
technological procedures such as "profiling" in order to 
assess current readiness level(s) of entire organization & 
its various components 
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MOTIVATORS & DE-MOTIVATORS 
(Page 5, Cont'd) 



FACTOR 


MOTIVATOR(S) 


DE-MOTIVATOR(S) 


Professional Networks 


* Greater sharing of experiences, ideas & solutions to potential 
problems among program participants 

Satisfaction with increased opportunities for communication 

* Fosterinc a result! ni? sense of "conneratinn vs rnmnptitinn'* 

perceived by program participants 
^ Greater opportunities for networking with other existing 
organizatioiiS & groups (e.g., professional teacher associations) 


* Failure to provide an ongoing mechanism for other progriun 
participants to meet & exchange information & ideas relative 
to program implementation 

ixcouiiiiig t'Uiii^A^iiiiun, Vo4 t'Uupcrdiiun among uiese 
participating disuricts 

Corresponding failure to capitalize on the natural intrinsic 
rewards of network members meeting, communicating & 
sharing their ideas/expenenccs 


State Finance & Funding 


* Increased communication between legislators & program participants 

* As a result, development of legislation which "strikes the proper 
balance** between structure & flexibility regarding unique local 
conditions 


* Poor fiscal budgeting practices (e.g., underestimation of costs 
and/or overestimation of revenues received) 

* Automatically allocating entire amounts received for "increased 
teacher salaries," while making little/no provision for such 
necessary expenditures as "development of local R&D unit" 
or "consultant assistance to acquire technology to measure 
student achievement validly" 


State Governing Board 
(Accountability/ 
Implementation) 


Increased communication betwen legislators & program participants 

* As a result, development of legislation which "strikes the proper 
udidnce Dciween suuciurc oc iicxiDiiiiy rcguromg unicjuc locai 
conditions 


* Possible development of solidified, bureaucratic & excessively 
rigid/authoritarian structure for rule-making 

* Correspondingly, liltlc/no consideration for unique local 
conditions which would nccessitiate some flexibility in 
legislation 

* Litde/no incentive for innovation & incorporation of new ideas 

* Non-existent/poor channels of communication between 
legislators & representatives of participating districts 


Legislative Guidelines 


Increased communication between legislators & program participants 

* As a result, development of legislation which "strikes the proper 
balance" between structure & flexibility regarding unique local 
conditions 


* Possible development of solidified, bureaucradc & excessively 
rigid/authoritarian structure for rule-making 

* Correspondingly, littlc/no consideration for unique local 
conditons which would nccessiU)tc some flexibility in 
legislation 

* LitUe/no incentive for innovation & incorporation of new ideas 

* Non-existent/poor channels of communication between 
Icgishilors & rcprcscnialivcs of parlicipaiing dislricls 
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MOTIVATORS & DE-MOTWATCRS 
(Page 6, Cont'd) 



FACTOR 


MOnVATOR(S) 


DE-MOTIVATOR(S) 


Analysis of Research 
Variables, Program 
Evaluation & 
Improvement 


♦ Application of "profiling" procedure to assist current leve!(s) of 
op^^rational health of each critical organizational support & focus 
factor, especially prior to initiation of external reform programs 
such as Career Laders 

♦ Using results of profiling to initiate remedial processes/procedures 
to improve those support & focus factors vvuich may be 
currently below par 

♦ Ongoing evaluation^rofiling of each individual component with 
respect to its functioning & readiness for overall program goals 
such as improved student achievement & teacher accountability 

♦ Procedures for incorporating other new m ultinethod technology 
into evaluation & local R&D activities 

Ongoing & reliable channels of direct teacher input into decision 
making which directly affects them (e.g., policy development) 

♦ Increased opportunities to plan & conduct locally based research 
studies in areas such as the following: 

a) student achievement 

b) teacher accountability 

c) effectiveness of local instructional practices 

H^ i^QiiPQ nf tpjirh^*r mnral^* fiimn\//*r Mr 

\J J lOOUWO KJl l\>aKfH^l IIIVJICIK^, lUlllvlVQI, CIC*. 


* Inadequate research base (decisions not based on timely, relevant 
& reliable data resulting from application of latest multimethod 
quantitative & qualitative assessment procedures) 

* Failure to develop adequate long-run syalegic plans (e.g». 
haphazard, "seal-of-the-pants," "fighting fires" type of 
day-to-day decision making) 

* "Too far to go - & don*t know how to get there" 

* Failure to apply diagnostic/remedial "profiling" procedure 
to correct inadequacies within tiic organizational structure 
& to initiate corrective improvement activities 

* Failure to acquire & incorporate other current multimethod 
technological procedures for long-range planning, 
evaluation & implementation 

* Little/no incentive for innovation & incorporation of new ideas 

* Failure to incorporate direct input from administrators, teachers 
& other personnel affected by the program into its day-to-day 
planning, implementation & evaluation activities 

* Failure to develop valid & reliable evaluation procedures which 
are perceived as "fair & objective" by those being evaluated; 
e.g., authoritarian and/or haphazard approaches to evaluation 

raiiure lo mciuae leatner oc aammisirator mput mto tne 
development & refinement of such an evaluation system 

* Using evaluation criteria which, while perhaps "measurable," 
do not adequately measure key aspects of student achievement 
& teacher accountability (e.g.. process evaluation only; or 
"cookbook" approaches to assessing teacher performance) 



